Spin Liquid Phase in Anisotropic Triangular Lattice Heisenberg Model 
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Based on exact diagonalization and density matrix renormalization group (DMRG) method, we 
show that an anisotropic triangular lattice Heisenberg spin model has three distinct quantum phases. 
In particular, a spin-liquid phase is present in the weak interchain coupling regime, which is char- 
acterized by an anisotropic spin structure factor with an exponential-decay spin correlator along 
the weaker coupling direction, consistent with the CS2CUCI4 compounds. In the obtained phase 
diagram, the spin liquid phase is found to persist up to a relatively large critical anisotropic cou- 
pling ratio J'/J = 0.78, which is stabilized by strong quantum fluctuations, with a parity symmetry 
distinct from two magnetic ordered states in the stronger coupling regime. 

PACS numbers: 74.20.Mn,71.10.Hf,75.10. Jm,71.27.-|-a,75.30.Ds 



Two dimensional (2D) frustrated spin systems have 
attracted intensive studies as they may exhibit uncon- 
ventional magnetic properties [1, 2, 3, 4]. The isotropic 
spin- 1/2 Heisenberg antiferromagnet (HAFM) on a tri- 
angular lattice was a candidate for the realization of 
a disordered spin- liquid phase [1], but it turns out to 
exhibit a three-sublattice antiferromagnetic-long-range- 
order (AFLRO) as established by analytic [5, 6, 7, 8] and 
numerical [5, 9, 10] studies. Among various spin mod- 
els, a spin-liquid phase has been established for more 
geometrically frustrated systems on the kagomc lattice 
[11, 12], dimer models [13] and models involving four 
spin exchange terms [14]. The Heisenberg models on the 
square lattice with third-nearest-neighbor couplings may 
also have a spin-liquid ground state as revealed by recent 
numerical studies based on DMRG calculation [15]. 

From the experimental point of view, the HAFM on 
an anisotropic triangular lattice is particularly interest- 
ing as it is directly relevant to the quantum magnet in 
the CS2CUCI4 compounds [16, 17, 18], which may be de- 
scribed by a minimal model at half- filling [19]: 

i/= J^S, .8, + J' -S, (1) 

Here Si are spin-1/2 operators, and J, J' > are the 
nearest-neighbor couplings along the chain (J) and the 
other two axes (J') between different chains on a trian- 
gular lattice. 

Based on the variational Monte Carlo (VMC) method, 
a resonating valence bond (RVB) wave function was 
previously proposed [19] to describe the low-lying 
anisotropic spin excitation observed experimentally [16, 
17, 18] in these systems, which suggests a gapless spin- 
liquid state. The model has also been studied by differ- 
ent analytic approaches such as spin wave theory (SWT) 
[6], large-S* expansion [8], as well as the series expansion 
[20, 21]. These works have predicted magnetic ordered 
states at J' > 0.3 J±0.03 J side, while the magnetic order 



vanishes on the smaller J' side suggesting a disordered 
phase. The recent series expansion study by Zheng et al. 
[21] has further indicated that quantum rcnormalizations 
strongly enhance the one-dimensionality of the spectra, 
which implies that a more accurate description of quan- 
tum effects is needed. Thus exact calculations with tak- 
ing into account all the quantum fluctuations are highly 
desirable in order to further establish the existence of 
spin-liquid phase, properly determine the quantum phase 
diagram as well as the nature of quantum phase transi- 
tions. 

In this Letter, we present a systematic numerical study 
of the magnetic phase diagram of the HAFM model in 
the spatially anisotropic triangular lattice at zero tem- 
perature by using exact diagonalization (ED) and DMRG 
methods. The main results are shown in Fig. 1, where 
three quantum phases are found with very distinctive 
magnetic structure factors. At small J'/J, the ground 
state is a disordered spin liquid state, which smoothly 
connects to one-dimensional (ID) decoupled spin chains 
in the limit of J' — > 0. The long range three-sublattice 
spiral Neel ordered phase occurs at an intermediate 
J'/J ^ 1, and then a coUinear Neel ordered phase ap- 
pears beyond a larger J'/J. In particular, we find that 
the regime of the spin liquid phase extends over to a 
critical value, J'^/J = 0.78 ± 0.05, which is significantly 
larger than the one for magnetic disorder phase deter- 
mined by previous theoretical approaches [6, 8, 20]. Such 
a phase boundary has been reliably identified by a van- 
ishing first excitation energy, coinciding with the change 
of the ground state symmetry. By further performing 
a DMRG calculation [22, 23, 24] with periodic boundary 
condition (PBC)[25], we are able to establish an exponen- 
tial decay of the equal-time spin correlation function be- 
tween different chains, a hallmark for the 2D spin-liquid 
phase [26]. 

Specifically, we consider a finite size system on the 
torus with length vectors Li = iViai and Lo = iVoao con- 
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necting identical sites (i.e., a PBC system). Here ai and 
^2 [ai = (IjO), a2 — (l/2,\/3/2) in real space] are two 
primitive vectors of the triangular lattice. The coupling 
strength along ai is J and along both a2 and = a2 — ai 
is J'. The total number of sites is N = Ni x N2. The 
ground state is determined by a Lanczos diagonalization 
of the Hamiltonian using all symmetries [9, 27] for sys- 
tem sizes up to iV = 36 (corresponding to a Hilbert space 
of a dimension Nh = 63092837). On the other hand, the 
DMRG method [23, 24] allows us to extend the exact 
calculation to larger systems up to = 8 x 18 sites (i.e., 
8-legs) [25]. 




FIG. 1: (Color online) The static structure factor for — 
6x6 site at different coupling strengths: (a) J' / J — 0.6; 
(b) J'/J = 1; (c) J'/J = 1.3. (d) and (e) are the phase 
diagrams obtained from the ED in the present work and the 
linear SWT [6], respectively. 

We first present the structure factor (SF) of the statis- 
tic spin correlation 5'(Q) = J^ij e'^<^^-'^^'> {S^ S^-) /N in 
Fig. 1 for a system of 6 x 6 sites at J' = 0.6J, J' = J, 
and J' = 1.3 J, respectively. For the smallest J' (shown 
in Fig. 1(a)), S'(Q) is peaked along the hues Ux = ±3, 
corresponding to magnetic wavevectors Qx = ±7r, while 
it only shows a slight dependence on Uy [the compo- 
nents of n used here are related to the wavevectors Q 
by Qx = 2Tmx/Ni and Qy = ^TT{nx/2Ni + ^ly/N2)/^/^. 
This is a typical feature of weakly coupled spin-chains 
with strong antiferromagnetic spin correlations within 
each chain, whereas the correlations between the chains 
are short ranged (see also Fig. 3 below). As J' is in- 
creased towards the isotropic point J' = J (shown in 
Fig. 1(b)), S'(Q) is qualitatively changed with the peaks 
moving to n = ±(4, —2), corresponding to wavevectors 
Q = ±(47r/3, 0) which represents the three-sublattice 
(spiral) Neel state, in agreement with the AFLRO ground 
state for the isotropic triangular lattice [8, 10, 27]. In the 
region of 0.78 < J' < 1.15, besides the major peaks at 
n = ±(4, —2), there are also minor peaks at n =(0,±3) 
as well, which may indicate the incommensurate spin cor- 
relation in this region. When J' is further increased to 



J'/J — 1.3 (shown in Fig. 1(c)), the peaks of S'(Q) move 
to n=(0, ±3) or Q = (0, ±27r/\/3), which are exactly 
the ordering vectors for a long-range coUinear Neel order 
along both a2 and as-axes. 

Thus we have seen that when the anisotropy param- 
eter J'/J varies from to 2, the ground states exhibit 
three distinct phases with the SF structures dramatically 
different from each other. The corresponding phase di- 
agram is given in Fig. 1(d), where two critical points 
J^i/J = 0.78 ± 0.05 and J^^/J = 1-15 ± 0.1 separate 
the spin disordered phase from the left side (the small J' 
regime), the spiral Neel ordered phase in the middle, and 
the collinear Neel ordered phase on the right side (the 
large J' regime), respectively. 

FIG. 2: The excitation energy AE = {Ei-Eo)/N, for system 
sizes 6x6 (•), 8 x 4 (□), and 6x4 (x), in units of J. 




J'/J 



As J'/J crosses the phase boundaries in Fig. 1(d), not 
only the characteristic SF changes, but the low energy 
spectrum also qualitatively changes. In Fig. 2, AE as 
the energy difference (per site) between the first excited 
state El and the ground state Eq is plotted as a function 
of J'/ J for three different system sizes: Af = 6x4, 8x4 
and 6x6. As J'/ J is increased from the weak side, AE 
decreases monotonically. Remarkably, at the critical J'^i , 
AE vanishes exactly where the ground state and the first 
excited state crosses each other. As a matter of a fact, 
the parity symmetry (the reflection along a symmetric 
axis of the systems) for the ground state also undergoes a 
change, from the odd parity at J' < J'^i to the even one at 
J' > J'ci- The vanishing AE at finite TV's and a discrete 
symmetry change suggest a first-order phase transition 
occurring at J'^^. Here it is noted that the qualitative 
behavior of the SF as a function of J' is independent 
of the system sizes in the ED calculation (with N — 
24 — 36) and the phase boundary for the spin liquid phase 
shown in Fig. 2 do not change much when N is changed, 
both suggesting weak finite-size effect in our calculation. 
When J'/J is further increased to around J'^2 = 1-15 ± 
0.1, AE reaches to an another minimum with a finite but 
very smah value [AE ~ (0.0015 ± 0.0005) J]. Together 
with the observation in a drastic change in the SF around 
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this point, it indicates that the system undergoes another 
phase transition from the spiral Neel state to the colhnear 
Nccl ordered phase. It could be a continuous transition, 
and /S.E is expected to vanish in the thermodynamic limit 
N ^oo. 
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FIG. 3: Absolute value of spin-spin correlation function 
|C'(?/)I = K'S'oS'yaa)! along the a2 direction in six-leg sys- 
tem (x) with A'^ = 6 X 18 and cight-lcg system (o) with 
iV = 8 X 18 at different coupling strengths: (a) J'/ J = 0.6; (b) 
J' I J = 0.3. Wc also present the corresponding |C(j/)| from 
the ED at A'^ = 6 X 6 for comparison. The dashed lines are 
the fittings to the corresponding data by exponential func- 
tions. The insets are accuracy of the ground state energy 
A = \{E{ni) — E{^)|E^^\ {Eo is the exact energy from ED) as a 
function of state number m kept in each block in the DMRG 
calculation for 6 x 6 system. 

One of the most interesting features of the phase di- 
agram determined by the ED in Fig. 1(d) is that the 
regime of the spin liquid phase on the small J' side per- 
sists up to J^i ~ 0.78 J, which is much larger than ~ 0.3 J 
obtained by the linear SWT [6] shown in Fig. 1(c). This 
difference may be attributed to the importance of quan- 
tum fluctuations [21] in the model, which could have been 



underestimated in the linear SWT approach. We have 
carried out a standard SWT calculation by taking into 
account the magnon scattering and the gconictric;al frus- 
tration [7, 9] up to the second order. Our result shows 
that the boundary of the disordered region indeed moves 
up to = 0.39J from the linear SWT J^^ = 0.27J. 
The upper boundary of the spiral ordered state is around 
J'/J'^ 1.15, which is close to the one obtained by series 
expansion in Rcf. 20, while both scries expansion and 
spin wave theory suggest that spin disordered state may 
survive in a region or at a point between spiral state 
and colincar state [6]. However, we are not able to di- 
rectly check this conjecture due to the limited system 
size, although the fast change of SF within a small re- 
gion 1.15 < J' / J < 1.2 might indicate the existence of a 
disordered state [20]. 

To check the possibility of realizing an incommensurate 
spiral ordered state disfavored by PBC in small system, 
we carry out the calciilation with twisted boundary con- 
dition (TBC) Sr.+L„ = i?z(Q-L„)Sr, [11, 27] (a = 1,2), 
with Q being the classic magnetic wavcvector and 
being the spin-rotation operator. It is found that in the 
region of J'^i < J' < J^2' ground state energy of Eq 
with TBC is slightly lower than the one with PBC (for 
24— 36 sites systems). Once J' goes beyond this region, 
PBC always gives smaller ground state energy. Moreover, 
in the spiral ordered region (J^i, Jc2)i the ground state 
energy from ED method is close to that obtained by the 
series expansion Eo{SE) [20], which may be numerically 
accurate if suitable expansion states are chosen. How- 
ever, outside this region, Eq from ED is systematically 
lower than the energy Eo{SE) with spiral order, which 
indicates that the spiral ordered state may not be stable 
outside the region of {J'ci,J'c2)- 

To further examine the magnetic characterization of 
the spin-liquid phase, we have also performed the DMRG 
calculation for larger system sizes. In particular, our 
DMRG code works with PBC [24], which can reproduce 
all the ED results for < 36 systems and extend the 
study up to a system size of 8 x 18. The system is set- 
up as four blocks with replacing the single-site block in 
standard DMRG by a block of Ni/2 sitcs[25]. In the in- 
sets of Fig. 3, we present the relative error of the ground 
state energy A = ^o'^"^~^o as a function of state number 
m kept in the main block in the DMRG calculation for 
6x6 system. Here Eq are the ground state energy from 
ED calculation. By keeping up to m = 500, we obtain 
an accuracy lower than A = 1.4 x 10^'' for PBC system. 
For longer length system, by extrapolating the Eo{m) to 
large m limit to obtain an estimate of the ground state 
energy to serve as Eq (where no exact resiilts exist), we 
found that the error-bar remains around 10~^ for all 6- 
leg systems and around 10~^ for 8-leg systems as long 
as we keep m up to 800 with a discarded density matrix 
weight around 10~^. We have also applied the standard 
DMRG method[23] by keeping m = 1500 states (with 
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adding single site to each block) and the same ground 
state energies with similar error bar were obtained for 
both 6-leg and 8-leg systems. 

In Fig. 3, wc present the spin correlation function 
C{y) = {S^Sy^^) as a function of the distance between 
two sites along the a2 axis (weaker coupling direction). 
In Fig. 3(a) for J' = 0.6 J, one first notices that the data 
from the ED on a 6 x 6 lattice agrees quite well with the 
DMRG results for larger system sizes (A'' = 6 x 18 and 
8x 18). |C(j/)| decreases by about six orders of magnitude 
as y increases, following an exponential-decay law which 
can be well fitted by the dashed line: |C(y)| oc e-f/°-5^^ 
at y < L2/2. As our system is on a torus (PBC), |C(j/)| 
turns back when y exceeds the half of ^2- In Fig. 3(b), 
\C{y)\ at a weaker J' = 0.3 J is shown, which exhibits 
similar behavior, except that the exponential-decay cor- 
relation length has been reduced from 0.544 to 0.418. On 
the other hand, along the chain direction (ai), we have 
found that C{x) follows a power-law behavior at small 
J', consistent with the one-dimensional peaks in the SF 
shown in Fig. 1(a). The remarkable similarity in the 
spin correlator between J' = 0.6 J and J' = 0.3 J further 
supports the ED phase diagram where spin-liquid phase 
extended to a large critical J'^i = (0.78 ± 0.05) J. How- 
ever we point out that we can not exclude the possibility 
of the system developing an extremely small magnetic or- 
der or breaking lattice symmetry in the thermodynamic 
limit, which may not be revealed by finite-size calcula- 
tions. 

In conclusion, we have performed the ED and DMRG 
calculations of the HAFM on an anisotropic triangular 
lattice. We have demonstrated that the ground states of 
this system vary from the disordered spin-liquid state to a 
spiral ordered state, and then to a coUinear Neel ordered 
state, when the anisotropic parameter J'/ J is continu- 
ously increased. Prom the characteristic features of the 
spin structure factor, the first excitation energy, as well 
as the exponential decay behavior of the spin correlator, 
we establish the existence and robustness of a spin-liquid 
phase, beyond a previous VMC study [19]. The char- 
acterization of such a spin-liquid phase demands further 
theoretical studies [28]. Our results provide a possible 
explanation of the spin-liquid behavior in the dynamic 
structure factor and the quasi ID spin excitation spec- 
trum found in the CS2CUCI4 compounds. Stabilized by 
quantum fluctuations, such a spin liquid phase is also 
expected to be observed experimentally in systems with 
much stronger interchain couplings. 
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